gradient descent
Từ liên quan
optimizationalgorithmcalculusderivativegradientcost functionloss functionlearning rateconvergenceminimumlocal minimumglobal minimumsaddle pointbackpropagationneural networkmachine learningdeep learningstochastic gradient descentmomentumoptimizerparameterweightbiasiterationepochconvexitypartial derivativevectorscalarmanifoldslopecurvatureHessianJacobianoverfittingunderfittingregularizationobjective functionhyperparametertraininginferenceregressionclassificationlinear regressionlogistic regressionactivation functionsigmoidtanhdivergenceplateaulandscapestochasticitynoisedecayannealing